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Abstract 

In this paper, we propose a new evolve-then-filter reduced order 
model (EF-ROM). This is a regularized ROM (Reg-ROM), which 
aims at the numerical stabilization of proper orthogonal decomposi¬ 
tion (POD) ROMs for convection-dominated flows. We also consider 
the Leray ROM (L-ROM). These two Reg-ROMs use explicit ROM 
spatial filtering to smooth (regularize) various terms in the ROMs. 

Two spatial filters are used: a POD projection onto a POD sub¬ 
space (Proj) and a new POD differential filter (DF). The four Reg- 
ROM/filter combinations are tested in the numerical simulation of the 
three-dimensional flow past a circular cylinder at a Reynolds number 
Re = 1000. Overall, the most accurate Reg-ROM/filter combination 
is EF-ROM-DF. Furthermore, the spatial filter has a higher impact on 
the Reg-ROM than the regularization used. Indeed, the DF generally 
yields better results than Proj for both the EF-ROM and L-ROM. 
Finally, the CPU times of the four Reg-ROM/filter combinations are 
orders of magnitude lower than the CPU time of the DNS. 

Key Words: Reduced order model, proper orthogonal decomposition, 
regularized model, stabilization method, spatial filter, differential filter. 
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1 Introduction 


Important applications require repeated numerical simulations with a high 
computational cost [251 m E3] [36]. To enforce a balance between accuracy 
and computational cost, reduced order models (ROMs) emerge as natural 
choices. The proper orthogonal decomposition (POD) is one of the most 
successful approaches for ROM development. An accurate numerical simu¬ 
lation is used in POD to extract the dominant structures, which are then 
used in a Galerkin approximation of the underlying equations [26, 39]. In 
this paper, POD will be exclusively used to construct ROMs. 

Although ROMs have been successful across a range of disciplines, their 
use in convection-dominated flows has been hampered by their notorious 
numerical instability. Indeed, since the number of POD basis functions is 
usually small (e.g., 0(10)), the standard ROM provides an efficient surrogate 
model for the underlying flows. However, for convection-dominated flows, the 
standard ROM does not represent a viable tool [HI El DEI 1231 Ell EH HU 112] , 
since it generally yields spurious numerical oscillations. These results clearly 
indicate the need for ROM stabilization. Over the years, numerous strategies 
have been devised to alleviate this numerical instability of the standard ROM 
(see, e.g., 0 0 0 E31 EH 1121 EH EH EH HE E21 S3] and references therein). 

In this paper, we investigate regularized ROMs (Reg-ROMs), which use 
explicit spatial filtering to stabilize the ROMs and enable their use in convection- 
dominated flows. The idea of using a spatial filter to stabilize numerical 
simulations with spectral methods has a long history fH] 16], :2jT SI ESj . In 
ROMs, spatial filtering has been used as a preprocessing step, to filter out 
the noise in the snapshot data, i.e., in the generation of the POD modes (see, 
e.g., Section 5 in [7] for a survey of relevant work). We emphasize, however, 
that our approach is fundamentally different. Indeed, we explicitly use spa¬ 
tial filters to smooth (regularize) different terms in the actual ROMs, i.e., we 
modify the mathematical model, not the input data. The first explicit ROM 
spatial filter that we use is the POD projection (Proj), which is the projection 
of the ROM variables on a subspace of the POD space [2H, 31,132] • The other 
spatial filter that we employ is a POD differential filter (DF) [21, [221 [58]. 

In this paper, we put forth a new evolve-then-hlter Reg-ROM. We also 
extend and investigate the Leray ROM proposed in [38]. To our knowledge, 
the new EF-ROM and the L-ROM are the only Reg-ROMs in current use. 
Note that these Reg-ROMs are fundamentally different from the calibration 
approaches used in [Tj 0 IE! HU, 33] • Indeed, the Reg-ROMs investigated 
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in this paper use equations that are different from those employed in the 
standard ROM. The calibration models in [II l5l fl8l HU1 H3] . on the other hand, 
utilize the standard ROM equations and only calibrate their coefficients by 
utilizing a Tikhonov type regularization. 

The rest of the paper is organized as follows: In Section [2j we briefly 
present the POD and standard ROM. In Section [3j we discuss the ROM 
spatial filters (i.e., the Proj and DF). In Section [4j we employ the Proj 
and DF to lay foundations for the new evolve-then-hlter Reg-ROM and the 
Leray Reg-ROM. In Section [5j we present numerical results for the two Reg- 
ROMs and two ROM spatial filters for the three-dimensional (3D) flow past 
a circular cylinder at a Reynolds number Re = 1000. Finally, we draw 
conclusions in Section HI 

2 Reduced Order Modeling 

In this section, the POD, the standard Galerkin ROM and the centering 
trajectory are briefly presented. The Navier-Stokes equations (NSE) are used 
as mathematical model: 

u t — Re~ 1 Au + u ■ Vu + Vp = 0 , (1) 

V • u = 0, (2) 

where u is the velocity, p the pressure and Re the Reynolds number. In this 
paper, the NSE ([Tj) (|2]) are supplemented with the initial condition u(x, 0) = 
u 0 (x) and steady Dirichlet boundary conditions. 

2.1 Proper Orthogonal Decomposition (POD) 

One of the most popular reduced order modeling techniques is the POD, 
which we briefly describe next. For more details, the reader is referred to, 
e.g., [26] [33], 39]. The POD starts with the snapshots {u\, ..., u^ s }, which 
are numerical approximations of (fi])-® at N s different time instances. The 
finite element (FE) solutions of are considered as snapshots in this 

section. We emphasize, however, that other numerical methods can be used 
instead. The POD seeks a low-dimensional basis that approximates the snap¬ 
shots optimally with respect to a certain norm. In this paper, the commonly 
used L 2 -norm will be chosen. The solution of the minimization problem is 
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equivalent to the solution of the eigenvalue problem 

YY T M<p j = XjVj, j = (3) 

where ipj and A j denote the vector of the FE coefficients of the POD basis 
functions and the POD eigenvalues, respectively, Y denotes the snapshot 
matrix, whose columns correspond to the FE coefficients of the snapshots, 
M denotes the FE mass matrix, and N is the dimension of the FE space 
X h [T5j. The eigenvalues are real and non-negative, so they can be ordered 
as follows: 

Ai > A 2 > ... > Xr > Ar +] = ... = Ajv = 0. (4) 

The POD basis consists of the normalized functions which corre¬ 

spond to the first r < N largest eigenvalues. Thus, the POD space is defined 
as X r := span{<£ l5 ..., c p r }. 

The centering trajectory method is popular in ROM development [2BJ. In 
this approach, the snapshots {u \,..., u^ s } are replaced by {u\—U ,..., u^ s — 
U}, where U = is the centering trajectory and u l h — U are the 

snapshot fluctuations. Thus, the POD basis functions are computed from 
the snapshot fluctuations u\ — U, i — 1,, N s . The centering trajectory 
method is especially useful for problems that have steady-state nonhomo- 
geneous Dirichlet boundary conditions, such as the boundary conditions in 
the 3D flow past a cylinder investigated in Section [5j Since in this case the 
snapshot fluctuations u l h — U, i = 1,..., N s satisfy homogeneous Dirichlet 
boundary conditions, the centering trajectory method avoids the challenges 
posed by the nonhomogeneous boundary conditions in ROMs (see, however, 
p4 j for alternative approaches). Thus, in what follows, we will use the cen¬ 
tering trajectory approach. 

2.2 The Galerkin ROM (G-ROM) 

To develop the standard Galerkin ROM, we start by considering the POD 
approximation of the velocity 

r 

u r {x, t) = U(x) + ^ a j (t)ip j (x), (5) 

3 =1 

where {aj(t)}^ =1 are the sought time-varying coefficients that represent the 
POD-Galerkin trajectories. By using the POD basis in a Galerkin approx¬ 
imation of the NSE, the standard Galerkin ROM (G-ROM) is obtained: 
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Vi = 1,.. .,r, 

(^> ( D ( W r), V Vi ) + ^(w r ■ V)li r , ^ = 0 , (6) 

where D(rt r ) := ( Vu r + (Vu r ) T )/2 is the deformation tensor of u r . The G- 
ROM (JhJ) yields the following autonomous dynamical system for the vector 
of time coefficients, a (t): 

a = b + Aa + aBa, (7) 


where b, A, and B correspond to the constant, linear, and quadratic terms 
in the numerical discretization of the NSE 0-@, respectively. The initial 
conditions are obtained by projection: 

«j(0) = («o - U, (fij) . j — 1 ..... r. (8) 

The finite dimensional system (Jt]) can be written componentwise as follows: 
For all i — 1,..., r, 


(h(t) — bi + E w + EE Bimn&n 


(9) 


ra=l 


m=l n=l 


where 


6 . = -(U.VU.^)-- v 


2 /VU + VU 1 


■> VyJi , 


( 10 ) 


= -(U . V^,^) - ( Vm . VU, V .) - J- ( V ^ + V ^ T .Vy., : ) ,(11) 


Bimn i}Pm ' ^^Pni P’i) • 


( 12 ) 


3 Explicit ROM Spatial Filtering 

The Reg-ROMs discussed in Section [4] use explicit ROM spatial filtering to 
smooth the flow variables and increase the numerical stability of the models. 
In spectral methods, spatial filtering has been used for a long time to stabilize 
numerical simulations of convection-dominated flows M HSlESa 1221135] • In 
ROMs, spatial filtering has been used as a preprocessing step, to filter out the 
noise in the snapshot data and, thus, in the generation of the POD modes 
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(see, e.g., Section 5 in [7] for a survey of relevant work). We emphasize, how¬ 
ever, that the spatial filtering used in Reg-ROMs is fundamentally different. 
Indeed, in the preprocessing spatial filtering used in [7], the snapshots (i.e., 
the input data) are spatially filtered, but the ROMs (i.e., the mathemati¬ 
cal models) are not. In Reg-ROMs, on the other hand, some of the ROM 
terms are explicitly filtered and, thus, the mathematical model is modified. 
Two types of explicit ROM spatial filters are considered in this section: a 
POD projection (Section |3.1[ ) and a POD differential filter (Section |3.2[ ). The 
properties of these explicit ROM spatial filters are discussed in Section [373 


3.1 The POD Projection (Proj) 

For a fixed rq < r and a given u r G X r , the POD projection (Proj) seeks 
— suc j 1 ^hat 


(«%¥»*) - («'.»><). Vj = l,...ri. 


(13) 


The Proj (13) has been used for theoretical purposes, e.g., in the error anal- 

To our knowledge, the Proj has been used as an 


ysis of the G-ROM 
explicit ROM spatial filter only in 


3.2 The POD Differential Filter (DF) 

The POD differential filter (DF) is defined as follows: Let 6 be the radius of 
the DF. For a given u r G X r , find u r G X r such that 

(V - h 2 A) u r , cp^j = ( u r , ip 5 ), V j = 1,... r . (14) 

Differential Liters have been used in the simulation of convection-dominated 
flows with standard numerical methods (2TJ 122] , In reduced order modeling, 
the DF was first used in [38] in a periodic, one-dimensional (ID) setting. In 
this paper, we extend the DF used in [38] to a non-periodic, 3D setting. 


3.3 ROM Spatial Filter Properties 


The Proj ([13]) and DF (14) share several appealing properties 


They 


act as spatial Liters, since they eliminate the small scales (i.e., high frequen¬ 
cies) from the input. Indeed, the DF (14) uses an elliptic operator to smooth 
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the input variable. The effect of the Proj on an input from the POD space X r 
is the elimination of the components corresponding to the POD basis func¬ 
tions {(fij}j =ri+ 1 , which generally correspond to small spatial scales (high 
frequencies), (ii) Both ROM spatial filters have a low computational over¬ 
head. Indeed, the Proj amounts to simply setting a,j — 0, j — rq + 1,..., r in 
the expansion u r (x, t) = U(x) + J2'j = i a j(t) < Rj( x )- The DF (14), on the other 
hand, amounts to solving a linear system with a very small r xr matrix that 
is precomputed, (iii) Both ROM spatial filters preserve incompressibility in 
the NSE, since they are linear operators. 

Although the Proj (13) and the DF (14) share the above properties, they 
are different in one significant aspect. Indeed, both the DF and Proj are 
explicit ROM spatial filters that eliminate the small spatial scales from the 
input data. We emphasize, however, that the DF uses an explicit length scale 
6 (i.e., the radius of the filter), whereas Proj employs an implicit length scale , 
which is determined by the collection of POD modes {y? -}£ =ri+1 . 


4 Regularized ROMs (Reg-ROMs) 

In the ROM setting, to ensure a low computational cost, only relatively 
few POD modes are generally included. Using the standard G-ROM ([6]) 
with a few POD modes in realistic flows yields numerical oscillations |23, HI 
M\. To alleviate this unstable behavior, we propose a new Reg-ROM, the 
evolve-then-filter Reg-ROM. Furthermore, we extend to the 3D, non-periodic 
NSE the Reg-ROM proposed in [38]. These two Reg-ROMs use the spatial 
filters defined in Section [3] to increase their numerical stability. Since the 
computational cost of the spatial filters is negligible, the computational cost 
of these Reg-ROMs will be very low, similar to the computational cost of the 
G-ROM. 


4.1 The Leray ROM (L-ROM) 

We extend to the 3D, non-periodic NSE the Leray regularized ROM (L- 
ROM) proposed in [38] for the ID, periodic Kuramoto-Sivashinsky equations: 
Vn = 0,..., M and Vi = 1,..., r, 

(d«), + (« ■ VK, (ft) = 0, (15) 
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where At is the time step. The filtered convective term in (15) is defined as 
follows: 


<(*,*) = U(x) + '^2a](t)(p j (x). 

3 = 1 


(16) 


The coefficients a” in (16) are defined as 


i=i i=i 


(17) 


where the filtering in (17) is effected by using the explicit ROM spatial bi¬ 
ters debned in Section 13.11 and Section 13.21 We note that a forward Euler 
time discretization was used in (16), but other time discretizations are pos¬ 
sible H9l. 


Remark 4.1 We emphasize that, in (16), only the unsteady (i.etime- 
dependent) component of uf was filtered; the steady centering trajectory 
component was not filtered. This approach is consistent with the very pur¬ 
pose of Reg-ROMs, i.e., smoothing (regularizing) only the ROM terms that 
are the main contributors to the ROM’s instability. Indeed, just as in the 
Fourier/spectral setting, the centering trajectory is generally the smoothest, 
most regular ROM component, whereas the smoothness of the velocity fluctu¬ 
ations decreases as their POD index increases. Thus, it is natural to expect 
that the velocity fluctuations and not the centering trajectory are generally 
responsible for the ROM’s instability. 


The L-ROM (15) yields the following hnite dimensional system: For all 
i = l,...,r, 


di(t) — bi + E Aim&m (*) + S Aim&m « + EE (t)a n (t), (18) 

m= 1 m=l m =1 n =1 


where 


6. = -(U.VU,*.)-- v 


2 /VU + VU 1 




Aim (U ■ Lpf) 

Aim = ifPm ■ VU,^), 

Bim n = ~(ip m ■ V(fin,<Pi) ■ 


2 f'V<P m + 'V<P r , 




(19) 

( 20 ) 

( 21 ) 

( 22 ) 
















The Leray model was first used by Leray [31] as a theoretical tool to prove 
local existence and uniqueness of weak solutions of the NSE. The Leray model 
has been recently used as a numerical tool in the simulation of convection- 
dominated flows with standard (e.g., FE) numerical methods [30] • To our 
knowledge, the Leray model was first used in a ROM setting in [38] for the 
numerical simulation of the ID Kuramoto-Sivashinsky equation in a periodic 
setting. In [38] . the spatial filter used was the DF. In this paper, we extend 
the L-ROM to the non-periodic 3D NSE. Furthermore, we investigate both 
the DF and the Proj as spatial Liters. 


4.2 The Evolve-Then-Filter ROM (EF-ROM) 

We propose a new Reg-ROM, the evolve-then-filter ROM (EF-ROM): Vn = 
0,..., M and Vi = 1,..., r, 


w 


n +1 


At 


^, Vi) + 1 - I B«), V Vi ] + ( « ■ V)<, if. 


Re 


u? +1 = w? +1 


= 0(23) 
(24) 


where At is the time step. The “evolve” step in the EF-ROM (i.e., equa¬ 
tion (J23|) is just one step of the time discretization of the standard G- 
ROM ([6]). The “Liter” step in the EF-ROM (i.e., equation (24)) consists 
of Lltering of the intermediate solution obtained in the “evolve” step. This 


Lltering in (24) is dehned as in (16)—(17), i.e., its unsteady component is Ll- 


tered, but its steady component (i.e., the centering trajectory) is not Lltered. 


This strategy is consistent with the Reg-ROM strategy (see Remark 4.1). As 


mentioned in Section 4.1, a forward Euler time discretization was used in 


(23), but other time discretizations are possible [19]. 

The evolve-then-Llter model has been used as a numerical tool in the 
simulation of convection-dominated Lows with standard (e.g., FE or spec¬ 
tral element) numerical methods [3D]. We emphasize, however, that, to our 
knowledge, the evolve-then-Llter model has not been used in a ROM setting. 


5 Numerical Tests 


Goals This section has two goals: The Lrst goal is to compare the EF- 
ROM (23R(24) with the L-ROM (15). The second goal is to investigate 
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the effect of explicit ROM spatial filtering (the Proj and the DF) on the 
L-ROM and EF-ROM. Numerical results are presented for a 3D flow past 
a cylinder at Reynolds number Re = 1000. We also include results for the 
G-ROM (§). A successful Reg-ROM should at least perform better than the 
G-ROM. Finally, a DNS projection of the evolution of the POD modes serves 
as benchmark for our numerical simulations. 

Models For each of the two Reg-ROMs (the L-ROM and the EF-ROM), 
two distinct filtering strategies are considered: the Proj and the DF. Thus, 
four Reg-ROM/hlter combinations are investigated. For clarity, the following 
notation is used for the resulting Reg-ROM/hlter combinations: L-ROM-DF 
for the L-ROM with the DF, L-ROM-Proj for the L-ROM with the Proj, 
EF-ROM-DF for the EF-ROM with the DF, and EF-ROM-Proj for the EF- 
ROM with the Proj. 

Criteria The qualitative behavior of the ROMs is judged according to the 
following six criteria m o) the kinetic energy spectrum; (ii) the mean 
velocity; (iii) the Reynolds stresses; (iv) the root mean square (rms) values of 
the velocity fluctuations; (v) the time evolution of the POD coefficients; and 
(vi) the Strouhal number. The first four criteria are statistics that measure 
the temporal and spatial average behavior of the ROMs, whereas the fifth 
criterion measures the instantaneous behavior of the ROMs. We also include 
a computational efficiency assessment for all the ROMs. Next, we briefly 
present these criteria. To this end, we first describe the averaging operator, 
which is used in all the statistics. In this paper, we use the averaging operator 
(') = (')tyz, which consists of averaging in time (over the time interval [0, 300]) 
and in the y- and z- directions. Specifically, to compute ( q) tyz for a given 
quantity q, for each fixed point x, we have 

(Q)tyz(x) = 1 — ^2q(x,y,z,t), ( 25 ) 

V Z t,y,z 

where T is the total time length (i.e., T = 300), L y is the dimension of the 
computational domain in the ^-direction, and L z is the dimension of the com¬ 
putational domain in the z-direction. Since the topology of the velocity held 
is markedly different in the x-, y -, and z-directions, one could also consider 
spatial averaging in the xz-direction ((•) = (■) txz ). We note that, since the 
numerical results with spatial averaging in the xz-direction are qualitatively 
similar to those with spatial averaging in the yz-direction, they are not in¬ 
cluded in the paper. 
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Energy Spectrum. All energy spectra are calculated from the average ki¬ 
netic energy of the nodes in the cube with side 0.1 centered at the probe 
(0.9992,0.3575,1-0625). 

Mean Velocity Components: The following mean velocity components are 
plotted: (u) (the mean streamwise velocity), (v) (the mean normal velocity), 
and (w) (the mean spanwise velocity). 

Reynolds Stresses: The following Reynolds stresses are plotted: (u — (u),v — 
(v)) (the xy-component of the Reynolds stress), (u — (u) , w — (w)) (the xz- 
component of the Reynolds stress), and (v — (v), w — (w)) (the yz-component 
of the Reynolds stress). 

RMS Values of Velocity Fluctuations: The following rms values of velocity 
fluctuations are plotted: ( u) rms = (u — (u),u — (u)) (the rms of the stream- 
wise velocity fluctuations), ( v) rms = (v — (v),v — (v)) (the rms of the normal 
velocity fluctuations), and (w) rms — (w — {w),w — (w)) (the rms of the span- 
wise velocity fluctuations). 

Strouhal Number: The Strouhal number (St) is computed as [21 E] 

f D 

(26) 

where / is the shedding frequency, t/oo is the streamwise velocity (i.e., the 
velocity at the inlet), and D is the diameter of the cylinder. Since we have 
limited the scope of this paper to just velocity ROMs, we do not consider a 
ROM representation of the pressure field. Hence we do not calculate the lift 
and drag coefficient spectra. Thus, we compute the shedding frequency / as 
the frequency corresponding to the first spike in the energy spectrum (see 
discussion on page 410 in [28]). 


Numerical Methods We investigate all ROMs in the numerical simulation 
of 3D flow past a circular cylinder at Re = 1000. The Reynolds number is 
computed using the diameter (D) of the cylinder as the length scale and the 
freestream velocity (Eoo) as the velocity scale. The cylinder is parallel to the 
£-axis and the free-stream flow is in the positive ^-direction. In this section, 
u denotes the streamwise velocity component (associated with the x-axis), 
v denotes the normal velocity component (associated with the y-axis), and 
w denotes the spanwise velocity component (associated with the z-axis). A 


11 



parallel CFD solver is employed on the time interval [0,300] to generate the 
DNS data. Details on the numerical discretization are presented in [2], [3, 0j. 

We obtain the POD basis by collecting 1000 snapshots of the velocity held 
(u, v, w) over the time interval [0, 75] and applying the method of snapshots 
developed in [3S]. These POD modes are then interpolated onto a structured 
quadratic FE triangulation with nodes coinciding with the nodes used in the 
original DNS finite difference discretization. The first r = 6 POD modes 
capture 84% of the energy of the velocity fluctuations. These modes are 
used in all ROMs. For all the ROMs, the time discretization employs the 
explicit Euler method with At = 7.5 x 1CT 4 and the spatial discretization 
uses piecewise quadratic Lagrange FEs. All the ROMs are investigated on 
the time interval [0,300]. 

Parameters The Reg-ROM results are plotted for the optimal values of 8 
(for L-ROM-DF and EF-ROM-DF) and rq (for L-ROM-Proj and EF-ROM- 
Proj). These optimal 8 and rq values are determined by requiring that the 
Reg-ROMs have the time average of the L 2 -norm of the solution as close 
as possible to that of the DNS. To find the optimal 8 value for L-ROM- 
DF and EF-ROM-DF, the time averages of the L 2 -norms of the solutions 
of these Reg-ROMs are plotted for 101 5 values in the interval [0,75]. The 
intersection between the Reg-ROM and DNS curves yields the optimal 5 
value. To End the optimal rq value for the L-ROM-Proj and EF-ROM-Proj, 
a similar approach is used. This time, however, since rq takes integer values, 
only a relatively low number of values is used in the optimization procedure. 
This approach yields the following values for the optimal parameters: rq = 1 
for L-ROM-Proj, 8 = 0.247 for L-ROM-DF, rq — 4 for EF-ROM-Proj, and 
8 = 0.001367 for EF-ROM-DF. We emphasize that these parameter values 
are optimal only on the short time interval tested (i.e., [0, 75]), and they might 
actually be non-optimal on the entire time interval [0,300] on which the Reg- 
ROMs are tested. Thus, this heuristic procedure ensures some fairness in the 
numerical comparison of the four Reg-ROMs. 

5.1 Numerical Results 

Before presenting the quantitative comparison of the ROMs, we give a flavor 
of the topology of the resulting flow holds. In Fig. [lj we plot seven isosur¬ 
faces of the velocity snapshots at t — 142.5 s for DNS, G-ROM, L-ROM-Proj, 
L-ROM-DF, EF-ROM-Proj, and EF-ROM-DF. Taking the DNS results as 
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a benchmark, the G-ROM, EF-ROM-Proj L-ROM-Proj yield inaccurate re¬ 
sults, in the form of unphysical structures. The L-ROM-DF yields more 
accurate results. The most accurate results, however, are produced by the 
EF-ROM-DF. Due to space limitations, only one time instance snapshot is 
shown for the ROMs. The general behavior over the entire time interval is 
similar. 

In Fig.[2j we plot the energy spectra of the four ROMs and, for comparison 
purposes, of the G-ROM. The five energy spectra are compared with the DNS 
energy spectrum. The energy spectra of the G-ROM and EF-ROM-Proj 
overestimate the energy spectrum of the DNS. The energy spectra of the 
L-ROM-Proj and L-ROM-DF, on the other hand, underestimate the energy 
spectrum of the DNS. The most accurate energy spectrum (i.e., the closest 
to the DNS energy spectrum) is clearly that of the EF-ROM-DF. 

In Fig. [3j we plot the mean velocity components for different values of 
x. Figure [3] yields the following conclusions: First, the mean streamwise 
velocity is computed accurately by all ROMs. Second, the G-ROM and EF- 
ROM-Proj yield inaccurate results for the mean spanwise velocity; all the 
other ROMs perform significantly better. Third, the EF-ROM-Proj yields 
inaccurate results for the mean normal velocity; all the other ROMs perform 
significantly better. 

In Fig. [4j we plot the Reynolds stresses for different values of x. Fig¬ 
ure [4] yields the following conclusions: First, the EF-ROM-Proj and G-ROM 
Reynolds stresses are consistently the most inaccurate (i.e., the farthest from 
the DNS Reynolds stresses). Second, the other ROMs have all similar be¬ 
haviors. Indeed, different ROMs might outperform the others over different 
spatial regions, but there is no clear “winner” over the entire spatial interval 
for any of the Reynolds stresses. 

In Fig. [5j we plot the rms values for different values of x. Figure [5] 
yields the following conclusions: Similar to the Reynolds stresses case, the 
EF-ROM-Proj and G-ROM rms values of the velocity fluctuations are consis¬ 
tently the most inaccurate (i.e., the farthest from the DNS rms values). The 
rms plots corresponding to the other ROMs, however, display a consistent 
ordering this time. Indeed, when the (v) rms and {w) rms plots are consid¬ 
ered, the EF-ROM-DF is slightly better than the L-ROM-DF. Furthermore, 
both are better than L-ROM-Proj. When the (u) rms plot is considered, the 
EF-ROM-DF, L-ROM-DF, and L-ROM-Proj perform similarly. 

The time evolutions of the POD basis coefficients a 2 (-) and ag(-) on the 
entire time interval [0, 300] are shown in Fig. [6j We note that the other POD 
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coefficients have a similar behavior. Thus, for clarity of exposition, we include 
only Q 2 (■) and ae(-)- The EF-ROM-Proj and G-ROM’s time evolutions of 02 
and ci6 are clearly inaccurate. Indeed, the magnitudes 02 and a§ are several 
times larger than that of the DNS projection. The L-ROM-Proj and, to a 
smaller extent, L-ROM-DF also yield inaccurate time evolutions of a 2 and 
a$. This time, however, these ROMs’ POD coefficients seem to decrease 
as time increases. The EF-ROM-DF clearly yields the most accurate POD 
coefficients. 

The Strouhal numbers predicted by the ROMs and the DNS are listed in 
Table [lj It is clear that the EF-ROM-DF yields the most accurate prediction 
of the Strouhal number, whereas the EF-ROM-Proj yields the most inaccu¬ 
rate prediction. Also note that the G-ROM fails to predict a clear shedding 
frequency and, thus, cannot yield a Strouhal number. 


Table 1: Strouhal numbers predicted by ROMs. 


DNS 

G-ROM L-ROM-Proj 

L-ROM-DF 

EF-ROM-Proj 

EF-ROM-DF 

St 0.2083 

0.1855 

0.1855 

0.2474 

0.1986 


A natural question, however, is whether the Reg-ROMs that we investi¬ 
gated are computationally efficient, which is one of the main requirements 
for any successful ROM. The CPU times of all four Reg-ROM/hlter combi¬ 
nations and G-ROM are listed in Table [2] The CPU time of the Reg-ROMs 
is on the same order as the CPU time of the G-ROM. In [42], we showed that 
the CPU time of the G-ROM is orders of magnitude lower than the CPU time 
of the DNS. Thus, we conclude that the Reg-ROMs’ computational efficiency 
is extremely high, similar to that of the G-ROM. 


Table 2: CPU times (in seconds) of ROMs. 


G-ROM 

L-ROM-Proj 

L-ROM-DF 

EF-ROM-Proj 

EF-ROM-DF 

92 

103 

104 

114 

101 


5.2 Summary and Discussion 

Table |3] displays the ranking of the four Reg-ROM/hlter combinations (i.e., 
L-ROM-DF, L-ROM-Proj, EF-ROM-DF and EF-ROM-Proj). The numbers 
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in Tabic [3] represent the rank of the Reg-ROM/hlter combinations (with 
1 the best and 4 the worst). We emphasize that the results in Table [3] 
represent a general evaluation of the Reg-ROM/hlter combinations for all 
criteria used. The following overall rankings emerge: The EF-ROM-DF is 
the most accurate with respect to all the criteria considered. Indeed, the 
EF-ROM-DF clearly yields: (i) the best energy spectrum (see Fig. [2j; (ii) 
the best rms values, although L-ROM-DF was a close second (see Fig. [5]); 
and (iii) clearly the best time evolutions of the POD coefficients 02 and a 6 
(see Fig. [6]). Furthermore, with respect to the other two criteria (the mean 
velocity components in Fig. [ 3 ] and the Reynolds stresses in Fig. [4]), the EF- 
ROM-DF performs at least as well as the other ROMs. Thus, we conclude 
that the EF-ROM-DF yields the most accurate average and instantaneous 
numerical results. The EF-ROM-Proj is consistently the least accurate. The 
L-ROM-DF and the L-ROM-Proj yield similar results, with an advantage 
for the former. Besides the rankings, Table [3] suggests that the spatial filter 
has a higher impact on the Reg-ROM than the regularization used. Indeed, 
the DF generally yields better results than Proj for both the EF-ROM and 
L-ROM. Finally, it should be emphasized that EF-ROM-DF, L-ROM-DF 
and L-ROM-proj performed significantly better than the standard G-ROM, 
whereas EF-ROM-Proj performed significantly worse than the G-ROM. 


Tabic 3: Ranking of the L-ROM-DF, L-ROM-Proj, EF-ROM-DF and EF- 
ROM-Proj. 


L-ROM-DF 

L-ROM-Proj 

EF-ROM-DF 

EF-ROM-Proj 

2 

3 

1 

4 
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Figure 1: Snapshots of horizontal velocity at t — 142.5s for: the DNS 
(top. left); the G-ROM (top, right); the L-ROM-Proj (middle, left); the L- 
ROM-DF (middle, right); the new EF-ROM-Proj (bottom, left); and the 
new EF-ROM-DF (bottom, right). Seven isosurfaces are plotted. 
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Figure 2: Kinetic energy spectrum of the DNS (blue) and the ROMs (red): 
(a) the G-ROM; (b) the L-ROM-Proj; (c) the L-ROM-DF; (d) the EF-ROM- 
Proj; and (e) the EF-ROM-DF. 


(a) 


(b) 


(c) 


(d) 


(e) 
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Figure 3: Mean velocity components of DNS and ROMs: (a) (u) (the mean 
streamwise velocity), (b) (v) (the mean spanwise velocity), and (c) (w) (the 
mean normal velocity). 
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Figure 4: Reynolds stresses of DNS and ROMs: (a) (? 
(the ^-component of the Reynolds stress), (b) (u — (u) ,w 
component of the Reynolds stress), and (c) (v — (v) ,w- 
component of the Reynolds stress). 
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Figure 5: Rms values of the velocity fluctuations of DNS and ROMs: (a) 
(■ u)rms = {u — (u) ,u — (u)) (the rms value of the streamwise velocity fluc¬ 
tuations), (b) ( v) rms = (v — (v) , v — (v)) (the rms value of the spanwise 
velocity fluctuations), and (c) {w) rms — (w — ( w) ,w — ( w)) (the rms value 
of the normal velocity fluctuations). 
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Figure 6: Time evolution of the POD basis coefficients a 2 (left column) and 
a 6 (right column) of the DNS (blue) and ROMs (red): the G-ROM (first 
row); the L-ROM-Proj (second row); the L-ROM-DF (third row); the new 
EF-ROM-Proj (fourth row); and the new EF-ROM-DF (fifth row). 





















































































































































































































































































































6 Conclusions and Future Work 


A new regularized ROM (Reg-ROM) was proposed: the evolve-then-filter 
ROM (EF-ROM). The Leray ROM (L-ROM) was also investigated. Both 
Reg-ROMs used explicit POD spatial filtering to regularize (smooth) some 
of the terms in the standard Galerkin ROM (G-ROM). Two explicit ROM 
spatial filters were investigated: a POD projection (Proj) on a subspace 
of the POD space and a POD differential filter (DF). To study the effect 
of the ROM spatial filtering on the Reg-ROMs, four Reg-ROM/hlter com¬ 
binations were considered: L-ROM-Proj, L-ROM-DF, EF-ROM-Proj and 
EF-ROM-DF. These four Reg-ROM/hlter combinations were assessed in the 
numerical simulation of the 3D how past a circular cylinder at Re = 1000. 
The Reg-ROM/hlter combinations were tested with optimal values of 8 (for 
the DF) and rq (for the Proj). These optimal values were determined by re¬ 
quiring that the DNS (benchmark) and Reg-ROM/hlter combinations be as 
close as possible on the average. We emphasize, however, that the parameter 
values were optimized on a short time interval ([0,75]), whereas the ROMs 
were investigated on a significantly longer time interval ([0,300]). The fol¬ 
lowing criteria were used in the numerical assessment of the Reg-ROM/hlter 
combinations: the kinetic energy spectrum, the mean velocity, the Reynolds 
stresses, the root mean square values of the velocity huctuations, the time 
evolution of the POD coefficients, and the Strouhal number. The numerical 
investigation of the four Reg-ROM/hlter combinations yielded the following 
conclusions: (i) The EF-ROM-DF was clearly the most accurate, the EF- 
ROM-Proj was the least accurate, and the L-ROM-DF was more accurate 
than L-ROM-Proj. We also note that the EF-ROM-DF, L-ROM-DF and 
L-ROM-Proj performed significantly better than the standard G-ROM. (ii) 
The explicit ROM spatial hlter had a higher impact on the Reg-ROM than 
the regularization used. Indeed, the DF generally yielded better results than 
Proj for both the EF-ROM and L-ROM. (iii) The CPU times of all four 
Reg-ROM/hlter combinations were orders of magnitude lower than the CPU 
time of the DNS. 

These hrst steps in the investigation of the new EF-ROM yielded encour¬ 
aging results. There are, however, several research directions that could be 
further pursued. For example, using an approach similar to that utilized 
in [335j| in a FE context could increase the EF-ROM accuracy by limiting its 
numerical dissipation. Furthermore, although the same explicit Euler method 
was used in all the ROMs (which ensured a fair comparison), one could inves- 


22 


tigate more accurate numerical discretizations. One could also test the new 
EF-ROM in the numerical simulation of more complex convection-dominated 
flows. The preprocessing spatial filtering in [7] should certainly be used to 
eliminate the noise in the snapshots (which, of course, is to be expected for the 
relatively coarse meshes utilized in complex applications). Although a neces¬ 
sary step in complex convection-dominated flows, this preprocessing spatial 
filtering will probably be not sufficient for ROMs that employ relatively few 
POD modes. In this case, one could investigate whether the new regularized 
EF-ROM can further stabilize the numerical simulations and allow accurate 
approximations of complex convection-dominated flows. Finally, one could 
perform a comparison of the new EF-ROM with other ROM stabilization 
strategies, such as those in [6] |9, D . [12] [T7, 27] 02, 43] . Of course, this would 
be a daunting task (which could possibly explain why it has not been per¬ 
formed so far); it would, however, provide invaluable insight to anyone who 
intends to use ROMs in realistic convection-dominated flows. 
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